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Ai r 1 1 c ndmcnt lo the Claims: 

In compliance whh the Revised Amendment Format, a complete listing of claims is 
provided herein. 

I . (Currcnily Amended) A method ofaugmenting an image of a scene, comprising: 

obtaining by a lirsi computing unit a digital image of a scene; 

acquiring by the firs I computing unit a digital elevation model ofihe scene, 
wherein I he digital elevation model c omprises data for creating a lliree-djmcnsjpnui 
perspective model of Ihe scene in nyo dimensions ttM*^d-^v-etevation data 
eotrasponding to inlbniiaHt-m-abrtuH-lw-seene; 

registering by the llrsv computing unil the digital image with tlic digital elevation 
model to create a registered digital image; 

providing the registered digital image from the first computing unit to a second 
computing unit coupled to Ihe first computing unit by a communications network; and 

augmenting the registered digital image provided lo the second computing unit 
with at least some af+he-in formation a bout the scene in response to input from the second 
computing unit. 

2. (Original) The melhod of claim 1, wherein obtaining Ihe digital image comprises 
obtaining an image of the scene in real time with a fixed image capturing device. 

3. (Original) The method ofclaim 1, wherein obtaining Ihe digital imago comprises 
obtaining an image of the scene in real time with a mobile image capturing device. 

4. (Original) The method ofclaim 1, wherein obtaining the digital image comprises 
obtaining a preexisting image of the scene. 

5. (Original) The method ofclaim I, wherein the obtaining comprises obtaining an 
analog image and digitizing the analog image. 
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6. (Original ) The method of claim I. wherein rho acquiring comprises ucquiring a 
preexisting digital elevation model. 

7. (Original) The method of claim 1, wherein the information comprises a location 
of m least one above-ground feature wiihin the scene. 

8. (Original) The method of claim 1 , wherein the information comprises a location 
of at least one underground feature wiihin the sc ene. 

'J. (Original) The method ol claim I, wherein (he obtaining comprises obtaining an 
image of the scene from an image-capturing device, the method further comprising determining 
an orientation and a zoom factor for the image-capturing device. 

1 0. (Original) The method of claim 9, wherein die image-capturing device is fixed, 
and wherein Ihc determining comprises reading positional and zoom factor information from the 
image-capturing device. 

1 1 . (Original) The method of claim J 0, wherein the positional information comprises 
latitude, longitude and elevation above ground. 

1 2. (Original) The method or claim 9, wherein the image-capturing device is mobile, 
and wherein (he determining comprises reading a zoom factor from the image-capturing device 
and obtaining the orientation from equipment posiiionally fixed relative to the image-capturing 
device. 

1 3. (Original.) The method o f claim 1 2. wherein the equipment comprises a global 
positioning system, a digital compass and a digital inclinometer. 
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14. (Original) The mciliod of claim 1 , further comprising rendering the registered 
digital image nt the second computing unit to produce a rendered image, wherein the augmenting 
comprises: 

identifying at Ihc second computing unit a point of i merest in the rendered image; 

providing the identified point of interest from the second computing unit to die 
first computing unit; 

reverse projecting (he identified point of interest at the first computing unit to 
determine coordinates therefor; and 

accessing Ihc information ai the first computing unit corresponding to the 
coordinates. 

1 5. (Original) The method of claim 14 n wherein the augmenting further comprises 
overlaying the information corresponding to the coordinates on the registered digital image. 

16. (Original) The method of claim 15, wherein the information comprises textual 
cartographic data. 

17. (Original) The method of claim 15, wherein the information comprises graphical 
cartographic data. 

1 8. (Original) 'Hie method of claim 1 , further comprising rendering the registered 
digital image at the second computing unit to create a displayed image, wherein the input 
comprises point ing by a user to at least one area oftlie displayed image. 

10. (Original) The melhod of claim l t wherein the communications nelwork 
comprises a global computer network. 
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20. (Curremly Amended) A system Tor augmenting an image of a scene, comprising: 
a computing unit programmable for: 
obiaining a digital image of a scene; 

acquiring a digital elevation model of the scene, wherein ihe digital elevaiinn 
model pomririscsjd^ of the s c ene in 

imdimejifuon^^ 

registering the digital image \\ iih Ihe digital elevation model to create a registered 
digital image; 

providing tho registered digital image over a communications network; and 

augmenting ihe registered digital image with ai leasi some oftne-mfbrmalion 
about the scene in response tn inpni 

2 1 . (Original) The system nf claim 20, further comprising a fixed image capturing 
device coupled to ihe computing unit for capturing an image oJlhe scene in real lime. 



(Original) The system ofclaim 20, further comprising a mobile image capturing 
device coupled to rhe computing unit for capturing an image of the scene in real lime. 

23. (Original) Thc\ystem of ck.im 2u, further comprising a scanner for digitizing an 
analog image of the scene. 

24. (Original) The system ofclaim 20. wherein the acquiring comprises acquiring a 
preexisting digital elevation model. 

25. (Original) The system of claim 20, wherein the information comprises a location 
of at least one above-ground feature within the scene. 

26. (Original) The system ofclaim 20, wherein the information comprises a location 
of at least one underground feature within Ihe scone. 
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27. (Original) The system of claim 20, further comprising an image-capturing device, 
the computing unit determining an orientation and a zoom factor for the image-capturing device. 

28. (Original) The system of claim 27, wherein the image-capturing device is fixed, 
and wherein the determining comprises reading positional and zoom factor information from the 
image-capturing device. 

2!). (Original) The system of claim 28, wherein the positional information comprises 
latitude, longitude and elevation above ground. 

30. (Original) The system of claim 27, further comprising orientation equipment 
positionally fixed relative to the image-capturing device, wherein the image-capturing device is 
mobile, and wherein the determining comprises reading a zoom factor from the image-capturing 
device. 

31. (Original) The system of claim 30, wherein the orientation equipment comprises a 
global positioning system, a digital compass and a digital inclinometer. 

32. (Original) The system of claim 20, further comprising another computing unit 
coupled to the computing unit via the communications network, the another computing unit 
comprising: a display for rendering the registered digital image to produce a rendered image; 
and a pointing device for identifying a point of interest in the rendered image; wherein (he 
augmenting comprises reverse projecting (he identified point of interest to determine coordinates 
therefor, and accessing the information corresponding to the coordinates. 

33. (Original) The system of claim 32, wherein the augmenting further comprises 
overlaying the information corresponding to the coordinates on the rendered image. 

34. (Original) The system of claim 33, wherein the information comprises textual 
cartographic data. 

35. (Original) The system of claim 33, wherein the information comprises graphical 
cartographic dnia. 



PAGE 13/20 * RCVD AT 6/30/20M 3:38:35 PM [Eastern Daylight Time] * SVR:USPT0-EFXRF-1/7 * DNIS:8729306 ' CSID:518 452 5579 * DURATION (mm-ss):05-04 



JUN..-30' 04 (WED) 15:41 HESLIN ROTHENBERG 



TEL:518 452 5579 



P 



-0- 0794.022 

36. (Original) The system ofclaim 32, wherein the communications nelwork 
comprises a global computer nelwork. 

37. (Currently amended) At leasi one program storage device readable by a machine, 
tangibly embodying at least one program of instructions uxeculahle by the machine lo perform a 
method ot'augmeming an image of a scene, the method comprising: 

obtaining by a lirst computing unit a digital image of a scene; 

acquiring by the llnsi. computing unit a digital elevation model of the scene, 
wherein the digital elevation model comprise s dara forcrealinga Three -dimen sional 
pers pective model u f the scene in two d ime nsions k-ba^d-on-elijvatii^n-fkftTt 
ewrespo n d in g-teH mfummtion ahom xho seen e; 

registering by the llrsi computing unit the digilal image with the digital elevation 
model U> create a registered digital image; 

providing the registered digityl image from the first computing unit to a second 
computing unit coupled lo the first computing unit by a communications nelwork; and 

augmenting die registered digital image provided to (he second computing unit 
wilh at least some ol-the-infonnaiion about the scene in response to input from the second 
computing unil. 

38. (Original) The at least one program storage device of claim 37, wherein obtaining 
Ihe digital image comprises obtaining a digiial image of the scene in real time from a fixed 
digital image capturing device. 

39. (Original) The at leasi one program storage device ofclaim 37, wherein ohiaining 
the digital image comprises obtaining a digilal image of the scene in real time from a mobile 
digital image capturing device. 

40. (Original) The at least one program storage device ofclaim 37, wherein ohiaining 
the digital image comprises obtaining a preexisling digital image of the scene. 
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41 . (Original) The at least one program storage device of claim 37, wherein acquiring 
(he digital elevation model comprises acquiring u preexisting digital elevation model. 

42. (Original) The at Icasi one program storage device of claim 37, wherein Ihe 
information comprises a locution of at leasi one above-ground feature within the scene. 

43. (Original) The al least one program storage device ofehiim 37, wherein the 
information comprises a location of al least one underground feature within the scene. 

44. (Original) The al least one program storage device of claim 37, wherein the 
obtaining comprises obtaining die digital image from a digital image-capturing device, Ihe 
method further comprising determining an orientation and a zoom factor for the digital image- 
capturing device. 

45. (Original) The at leasi one program storage device of claim 44, wherein the digital 
image-capturing device is fixed, and wherein the determining comprises reading positional and 
zoom factor in formation from the digital image-capturing device. 

4f>, (Currently Amended) The ac least one program storage device of claim [|"37 1 [ 45 . 
wherein the positional infonnalion comprises latitude, longitude and elevation above ground. 

47. (Original) The at least one program storage device of claim 44, wherein the digital 
image-capturing device is mobile, and wherein the derermining comprises reading a zoom factor 
from the digital image-capturing device and obtaining the orientation from equipment 
posilionally fixed relative to thedigilal image-capturing device. 

48, (Original) The yi least one program storage device of claim 47, wherein the 
equipment comprises a global positioning system, a digital compass and a digital inclinometer. 
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4 l J. ('Original) The at least one program storage device of claim 37, further comprising 
rendering Ihe registered digilnl image ai the second computing unit to produce a rendered image, 
wherein the augmenting comprises: 

identifying at the second computing unit a point of interest in the rendered image; 

providing Ihe identified point of interest from the second computing unit to the 
first computing unit; 

reverse projecting Ihe identified poinl of imprest al the first computing unit to 
determine coordinates therefor; and 

accessing the information at ihe first computing unit corresponding to the 
coordinates. 

50. (Original) The at least one program siorage device ofclaim 49, wherein the 
augmenting further comprises overlaying the information corresponding to the coordinates on 
the registered digital image. 

51 . (Original) The at least one program siorage device of claim 50, wherein the 
information comprises textual cartographic data. 

52. (Original) The at least one program siorage device ofclaim 50, wherein the 
information comprises graphical cartographic daia. 

53. (Original) The al leasi one program siorage device ofclaim 37, wherein Ihe 
communications network comprises a global computer network. 
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54. (Now) A system of augmenting an image of a scene, comprising: 

means for obtaining by a first computing unit a digital image of a scene; 

means Ibr acquiring by the first computing unit a digital elevation model of the 
scene, wherein the digital elevation mode! comprises data for creating a three- 
dimensional perspective model of die scene in two dimensions; 

means for registering by the llrst computing unit the digital image with the digital 
elevation model to create a registered digital image; 

means for providing the registered digital image from the first computing unit to a 
second computing unit coupled to die first computing unit by a communications network; 
and 

means Ibr augmenting ihe registered digiial image provided to the second 
computing unit with at least some information about the scene in response to input from 
the second computing unit. 
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